LaSSL: Label-Guided Self-Training for Semi-supervised Learning
نویسندگان
چکیده
The key to semi-supervised learning (SSL) is explore adequate information leverage the unlabeled data. Current dominant approaches aim generate pseudo-labels on weakly augmented instances and train models their corresponding strongly variants with high-confidence results. However, such methods are limited in excluding samples low-confidence under-utilization of label information. In this paper, we emphasize cruciality propose a Label-guided Self-training approach Semi-supervised Learning (LaSSL), which improves pseudo-label generations from two mutually boosted strategies. First, ground-truth labels iteratively-polished pseudo-labels, instance relations among all then minimize class-aware contrastive loss learn discriminative feature representations that make same-class gathered different-class scattered. Second, top improved representations, propagate across potential data manifold at feature-embedding level, can further improve labelling reference neighbours. These strategies seamlessly integrated promoted whole training process. We evaluate LaSSL several classification benchmarks under partially labeled settings demonstrate its superiority over state-of-the-art approaches.
منابع مشابه
Label Propagation for Semi-Supervised Learning in Self-Organizing Maps
Semi-supervised learning aims at discovering spatial structures in high-dimensional input spaces when insufficient background information about clusters is available. A particulary interesting approach is based on propagation of class labels through proximity graphs. The Emergent Self-Organizing Map (ESOM) itself can be seen as such a proximity graph that is suitable for label propagation. It t...
متن کاملSemi-supervised Learning for Multi-label Classification
In this report we consider the semi-supervised learning problem for multi-label image classification, aiming at effectively taking advantage of both labeled and unlabeled training data in the training process. In particular, we implement and analyze various semi-supervised learning approaches including a support vector machine (SVM) method facilitated by principal component analysis (PCA), and ...
متن کاملSemi-Supervised Learning by Mixed Label Propagation
Recent studies have shown that graph-based approaches are effective for semi-supervised learning. The key idea behind many graph-based approaches is to enforce the consistency between the class assignment of unlabeled examples and the pairwise similarity between examples. One major limitation with most graph-based approaches is that they are unable to explore dissimilarity or negative similarit...
متن کاملLabel Ranking with Semi-Supervised Learning
Label ranking is considered as an efficient approach for object recognition, document classification, recommendation task, which has been widely studied in recent years. It aims to learn a mapping from instances to a ranking list over a finite set of predefined labels. Traditional solutions for label rankings cannot obtain satisfactory results by only utilizing labeled data and ignore large amo...
متن کاملRobust Semi-Supervised Learning through Label Aggregation
Semi-supervised learning is proposed to exploit both labeled and unlabeled data. However, as the scale of data in real world applications increases significantly, conventional semisupervised algorithms usually lead to massive computational cost and cannot be applied to large scale datasets. In addition, label noise is usually present in the practical applications due to human annotation, which ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i8.20907